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ABSTRACT 

This paper focuses on ways in which on policy 

for improving education— standard-setting through testing 

mechanisms— affects the classroom teacher-learner relationship, that 
uniform policy-making is problematic is clear from observations of 43 
Mid-Atlantic school district teachers. Responding to three types of 
standards, 45 percent found minimum competency testing objectionable 
because a single measure cannot allow for student, resource, and goal 
differences. Likewise, standardized testing for decision-making about 
students was typically viewed as curriculum narrowing. The strongest 
reaction stemmed from competency-based approaches to teaching and 
learning that require test-passing for each discrete skill before 
moving on. Teachers generally found it difficult to adapt standard 
policies to the disparate needs of students, though many recognized 
the usefulness of a common educational direction. The heed for dual 
accountability-- to students and admin i strati on--i.s a problem that 
could be partially rectified through ensuring competency among 
teachers. Nonetheless , teachers familiar with the competency-based 
teacher certification, idea recently advanced by policy-makers again 
tended to oppose it: like teaching itself, learning to teach is a 
complex activity requiring behaviors varying from student to student, 
an attitude research confirms. Paper and pencil competency tests were 
also viewed skeptically; 60 percent of teachers opposed tests for 
recertif ication. In sum, policymakers must realize the collective 
impact of such policies since they may make teaching less attractive 
and thus work against themselves. (KS) 



ERLC 



UiS. DEPARTMENTS^ EDUCATION 
NATIONAL INSTIT-OTE.OF EDUCATION,. 
EDUCATIONAL RE5O0RCE5 INFORMATION 
CENTER (ERIC! 
Ntjhis document has been reproducer* as 
/Yeceived from the person or brganlidiion 

paginating it. 

Minor. changes have been made to improve 
reproduction quality. 

• Points of view or bpintdris stated in this docu- 
ment do not necessarily represent official NIE 
position or policy 



BEYOND STANDARDIZATION: STATE STANDARDS 
AND SCHOOL IMPROVEMENT 



Arthur E. Wise and Linda Darling-Hammond 

Stanford University, Stanford, California 



June 1983 



Paper prepared for the National Institute otl Education C<^£e^*>*«. 
on State and Local Policy Implications of Effective School Research 

Contract Number 400-79-0035 

Delivery Order Number NIE-D-82-O0O3CB) 



State policies intended to improve education generally try either 
to set educational standards or to shape the educational process. White 
states also seek to improve education through tfcJ allocation of funds, 
in recent years they have placed more emphasis on regulation— setting 
standards in the form of tests to be passed or educational procedures to 
be followed. Some policies are targeted on students; others on 
teachers. The policies, of course, also affect schools, school systems, 
and, in certain cases, schools of education. In this paper, however, we 
focus on how policies afreet the teacher- learner relationship as it 
occurs in classrooms. 

Policies intended to affect teaching and learning may seek to 

influence the goals, processes, or outcomes of education. In so doing, 

< 

policymakers must make choices about who will enforce a law, how 
specific its guidance will be, and what penalties will accompany non- 
compliance. They must imagine what the direct and indirect consequences 
of alternative decisions will be. Is compliance technically feasible? 
Will compliance lead to attainment of desired goals? Will other 
unintended effects occur? Will non-compliance be widespread? 

When they seek to influence what goes on classrooms, state 
policymakers must also consider how their policies will be transmitted 
over the long distance from the state capitol to the local classroom. 
Laws, by their nature, must be general, uniformly applicable, and 
enforceable from a distance* In order to reach teachers or students, 
the laws must depend on specified procedures for implementing and 
monitoring policy intentions. These procedures are enforced by a 
bureaucratic chain that extends from the state's center of bureaucratic 
authority to teachers who implement the state's in the classroom. 
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Bureaucratic implementation of policies can work under certain 
circumstances that satisfy the assumptions of the bureaucratic model: 

1 . When the relationship between policy means and ends is 
appropriate-- i.e., when the ends are attainable given the 
means, or when the means are reasonable given the ends; 

2. When procedures designed to ensure conformity to norms are 
appropriate— i.e., when conformity can actually be achieved if 
the procedures are followed and when the procedures are, 
themselves, technically and politically feasible; and 

3* When organizations operate rationally— i.e. » when they can 
establish consensual goals, plan and coordinate activities to 
meet those goals, and ensure that the activities are carried 
but as intended.[1] 

The first two conditions are prerequisites for effective policy 
itestffli . Policymakers must know that a clear relationship exists between 
means and ends; they mast know that the procedures specified wiu ensure 
conformity to the norms implicit in the policies. The third condition 
is a prerequisite for effective policy Impl e mentatio n . Policies can 
only be implemented ir an organization has the capacity to control the 
political and technical aspects of its work. The organization must be 
able to define clear-cut goals that are politically acceptable and 
manage the technical work process according to clearly-specified 
procedures that ensure desired outcomes. 

" [1] Arthur E. Wise, L e gislated Learning f Berkeley: University of 
California Press, 1979* 
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Educational policymaking at the state level is particularly 
problematic when it seeks to improve the quality of schooling by 
prescribing goals, processes, or outcomes related to the "production 11 of 
teaching or learning. This is because quite often the relation between 
educational means and ends is unknown, and the procedures for ensuring 
conformity to norms are politically or technically difficult to enforce. 
Educational policymaking is also problematic because school 
organizations do hot always conform to the rationalistic model of 
organizations. They do hot always have consensus on goals, values, and 
norms, and they cannot always specify techniques that will result in 
desired outcomes. 

In short, schools do not operate as model bureaucracies because the 
nature of teaching and learning work is not sufficiently technocratic, 
hor the nature of schooling sufficiently apolitical, to allow them to do 
so. This means that state policymaking about educational productivity 
matters must take into account important questions of implementation. 
Policymakers must understand how general, uniform policies based on 
partial knowledge of ends, means, and norms will wend their way down to 
the classroom in different school districts. 

In this paper we examine teachers' views of actual or proposed 
state policies intended to influence teaching and learning. We focus 
specifically on standard-setting as implemented through testing 
mechanisms. Because tests are increasingly the measure of goal 
attainment, it is important to understand bow both the policy goals and 
these implementation tools affect teachers and students. With respect 
to students, we examine test-based standards as well as test-based 



instructional processes. With respect to teachers, we examine test- 
based standards for entry and retention in the profession. 

We begin with the assumption that state policies, if they are to 
actually affect or improve education, must be mediated by teachers. 
Thus, it is important to know how teachers react to these policies ana 
what they perceive as the effects of the policies. How they perceive 
the policies will affect how they respond to efrorts to implement the 
policies. How teachers perceive the efrects of policies is one major 
source of data which, properly analyzed, can provide insights into 
policy design and redesign. Some data employed in this report are drawn 
from the authors' ongoing study of the Conditions of Teaching Work. 

The data are drawn from in-depth interviews with a sample of 43 
randomly selected teachers from three large school districts in the 
Middle Atlantic statei. The major purpose of the study is to gain 
ih-depth understanding of teachers' responses to policies that shape the 
conditions of their work. Thus, the sample is necessarily small and 
drawn from an even smaller number of districts so that district and 
state contexts can be better understood. 



Policies that set standards for students may take several forms. 
They may prescribe course requirements; they may specify learning 
sequences through which all students must pass; or they may establish 
outcomes levels that all students must achieve. In concrete terms, 
these policies may take the form of general or highly specific 
curriculum guides, broad outcome goals or particular tests that must be 




passed. 
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Standards directed at students are, of course, intended to 
influence the actions of teachers. Standard-setting is a means for 
rationalizing teaching by defining goals, methods for reaching the 
goals, and/or means for evaluating whether the goals have been achieved. 
Broadly speaking, standards are intended to improve the quality of 
education by focusing the attention of teachers and students on 
particular types of learning. Certain types of standards may focus 
attention on the required measurement tools rather than the policy's 
broad goals. 

The effects of standard-setting policies on classroom teaching 
depend on how specifically the policies prescribe outcome measures, and 
on how relevant the measures are to the teaching context--tfce particular 
students, subject area, and school environment within which teachers 
operate. Teachers 1 responses to standards depend upon the degree to 
which the policies impose constraints oh their ability to meet what they 
perceive to be the needs of their students. Their observations reveal a 
view of educational standards that is in some ways antithetical to the 
policymaking framework. The common meaning of a standard is that it 
provides a single, uniform measure of something. However, teachers 1 
views of standards often depend on how multidimensional or flexible they 
perceive the standards to be. 

Shulman addresses this seeming paradox in his discussion of the 
tensions between teaching and policy: 

Why is the juxtaposition of 'teaching* and * policy' the 

statement of a problem? We are wont to think of teaching as a 
highly clinical, artful, individual act. Since instruction is 
interactive, with teachers' actions predicated on pupil 
responses or difficulties, it appears ludicrous in principle 
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to issue directives regarding how teachers are to perform. * * 
. Teaching is the very prototype of the idiographic, 
individual, clinical enterprise. Policy connotes the remote* 
nomothetic, and unresponsive .[2] 

His theoretical analysis is borne out by teachers' actual responses to 
educational policies. Their observations about the efrects of test- 
based standards for students are most negative when their experience or 
expectations suggest inflexible application of policy tools. While many 
teachers support the establishment of generalized standards for 
students, they see dysfunctional consequences in the implementation of • 
highly specified unixori approaches to teaching and learning. Below we 
examine teachers' responses to three types of standards: minimum 
competency testing, standardized testing used for decisionmaking about 
students, and competency-based approaches to teaching and learning. 

Minimum Competency Testing 

In the late 1970s, the leading state education policy initiative 
was minimum competency testing (MCT). MCT is a device for conditioning 
student promotion or graduation bh test achievement. Id a 1979 survey 
of over 1 ,700 teachers conducted by the National Education Association, 
only 14 percent of the teachers polled favored the use of standardized 
test scores for determining student promotions. In the three states in 
which our three districts are located, minimum competency testing had 
been proposed and trial-tested, but not yet used to deny promotion or 
high school graduation to students. Nonetheless, teachers had had 
opportunity to reflect on its significance for them and to begin to 



Lee Shulman, "Autonomy and Obligation* in tee Shuiman and Gary 
Sykes (eds.), Handbook $f Teaching and Policy. NY: Longman, 1983, P- 
488, • 
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orient to it. In our sample^ 30 percent of the teachers favored MCT, 25 
percent favored it with qualifications, and 45 percent opposed it. 

Those who favor MCT do so because it establishes a clear standard 
and places the onus for reaching it on the student. 

I think it is good because this takes some of the 
responsibility and places it on the student. The student 
knows that he is not going to have time to oome to school and 
clown and act up ir he is going to be prepared to take that 
test • 



I think it's a good idea in a sense. I think it's gooa to set 
some standards for all students to meet. 



Some teacherr gave the idea of M6f support, but conditioned their 
support on how MCT would actually operate. One teacher thought it would 
be beneficial ir it operated in a Sophisticated way: 



I see a lot of general vslue in it, if it is a fairly 
sophisticated program with a lot of variables built in otner 
than specific achievement bh one test. I would like very much 
to see some work experience involved in a graduation J 
requirement. . I would like to see special projects being 
conducted under the supervision of a good teacher and let that 
be part of the requirement for graduation--not specifically a 
test score, but a broad range of things required before you 
can say that you have been graduated from high school. 

For this teacher and many others, the appeal of MCT is that it 
establishes a standard. However, the standard is a broad set of 
requirements rather than a single test score. Other teachers condition 
their support bh expectations that may be unrealistic: 



I can live with it. I don't think it determines the true 
quality of education, per se. It is always at a minimal level 
and it shows you where your greatest weaknesses are. [I can 
support it] as long as it doesn't put a rigidity in the 
, curriculum because that is where the problem occurs. It if _ 
requires you to stop and teach something that is hot part of 
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your normal curriculum design or your objectives* that would 
be the negative side. 

This teacher favors MCT on the condition that it hot interfere with the 
curriculum. 

Those who oppose MCT do so for a variety of reasons: 

I really hate to see a -student's passing or not passing based 
oh one test. 



It's not as objective as it seems to be. It really depends on 
the child. A child . . .may just not be able to score well 
on this test because of things that are happening in their 
personal if e, but maybe they know [the material]. I don't 
think that can be the entire evaluation. 



I can see some students never passing each year and having a 
15-year-old maybe in third grade. Wouldn't that be kind of 
devastating on society? 



i don't think it* sgood^ If you take this school district and 
compare it with district X or district 2, you don't have the 
same standards. Maybe you have the same materials, [but] you 
might not have as much extra help; you might not have as many 
activities or varied things for [students J to be associated 
with. I can't see how a state . . . can have a standardized 
test that is going to take into account all the individual 
differences they have in each district. Each district has 
different budgets, each district has difrerent area managers 
or administrators. I just don't see how they can come up with 
a valid test to pass state wide for something like promotion, 
f really don't agree with that. 



I would be opposed to it unless it was a very, very basic kind 
of thing. . . I would rather see it be under the leadership 
of a smaller group where they know their schools-- a county 
rather than a state. 
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I don't think they are all that effective or necessary. I 
think one of the difficulties is that ycu get into teaching 
for the test rather than accomplishing the same objective 
through other means. 

Teachers' various objections to statewide minimum competency testing are 
based on a view that a single, uniform measure cannot adequately allow 
for the differences in student responses or abilities, nor can it take 
into account the variations in local resources and goals that exist in 
education, they do not want a standardized measure of the 
nonstandardization tnat results from local control of the schools. Some 
fear that because the connection between the test and what it seeks to 
measure is tenuous, the means will substitute for the ends: the test 
will serve as the goal of instruction rather than as a measure of 
instruction or learning. 

the expectation that measures will become goals is well-founded. 
As we discuss below, standardized tests used in other contexts had 
important efrects on teaching, particularly if they are used to guide 
decisionmaking about students or teaching. 

Standardized Testing 

Even teachers who have not yet had direct experience with minimum 
competency testing have had experience with other types of standardized 
testing. While standardized testing is not a discrete state policy, 
state accountability and evaluation requirements have caused increased 
use of standardized tests for making decisions about student placement 
and instruction. Standardized testing has been a powerful force shaping 
life in the classroom. In bur sample, 60 percent of the teachers report 
"thai this increased emphasis has affected their teaching. More 
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significantly* when teachers were asked whether standardized testing 
affected other teachers, 95 percent report that standardized testing has 
had an effect. Thus, teachers perceive that the increased emphasis on 
standardized testing has affected the way they or their colleagues 
operate. 

Our content analysis of the interview responses revealed that 
effects fell into five categories: altered curriculum emphasis; 
teaching students how to take tests; teaching students for the test 
(specific preparation for the test); having less time to teach; and 
feeling under pressure. The most common effect reported by teachers 
about their own behavior was that they altered their curriculum 
emphasis. Some viewed this change positively and otners not. The most 
common effects reported about the behavior of their colleagues was that 
they taught for the test and felt pressured. 

Sense teachers value the increased emphasis upon standardized 
testing because it creates standards, expectations* and pressure. It 
causes them to change what they do in class in a direction they regard 



as valuable. 



In the areas where these tests are given, I feel it puts 
pressure on the teachers and I see it as a positive type of 
thing* good pressure, to teach and cover specific areas and to 
get that information across rather than waste their time oh 
what they happen to feel is important. I feel that there is a 
certain body of knowledge that kids should leave school with* 
and that standardized tests, if they 1 re written properly, 
ensure that teachers are going to teach that particular body 
of knowledge because they don't want to see all the kids fall 
in it. 



We go over those results very thoroughly in faculty meetings 
and look at all the areas that are either under expectancy Tor 
their IQ's or that are really lower than what we would expect* 
so that then we can give a little more emphasis to those 
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areas. Like one year capitalization and punctuation was 
extremely low and whether or not we had Just missed it tnat 
year or what or whether it was dust the kids that year f we do 
go back over the results and take a good look at them and see 
what happened. So, it might afreet what we would do in the 
future more tnan what we have done in the past. 



Thus, for some teachers, standardized tests are a means for ensuring 
that a body of knowledge is covered in the curriculum. In a broad 
sense, the use of tests helps them orient their instruction to important 
topics that might otherwise receive insufficient emphasis. 

More typically, however, teachers report that the use of testing as 
a management control device causes a narrowing of the curriculum. When 
tests are used as measures of teaching effectiveness or as indices of 
student competence, incentives are created for teaching the precise 
content appearing on the test rather than the educational concepts 



underlying the test. Some report that the emphasis on standardized 
testing causes them to teach tested knowledge at the expense of untested 
knowledge and to teach skills as they are to be tested rather than as 
they are used in the real world. 



I spend more time testing rather than teaching. It has 
eliminated time to do some of what a lot of teachers feel are 
frills. I do less science. I have always been very strong on 
science but you have got to meet the standards of those tests 
basically in math, reading and language arts. 



We've been more or less pressured from the top down, starting 
with the superintendent and supervisors and principals. 
Ifceref ore you teach to the test. You need to teach format of 
tests so that they understand the kind of test that they are 
gong to take. You teach similar types of problems that they 
are going to be faced with. There usually is a difrerence 
between the way it is taught in the classroom and the way it's 

tested on the test. For instance, in spelling you 1 re taught 

to spell a word correctly. The test is a proofreading test. 

, You find the word that is spelie \ wrong, or you look at a 



group of words and indicate that there are hone wrong. This 
is not the normal way of teaming in classroom ahyw^T| hor 
most others either. When you're talking about spelling it's a 
difficult thing because if you take the standardized tests you 
don't have someone giving a word for them to spell correctly - 
They've got to pick it but. 



I've changed my teaching behavior. • . . I do not use as many 
essay tests as I did before, because I try to give them things 

which they are apt to peet on standardized tests i I feel that 

it is hurting the children, rather than helping them because 
they don't have to write their own sentences. 



For these teachers, the heed to ensure that their students perform well 
on the tests has meant de-emphasizing other important types of learning. 
One reports that she cannot spent! time teaching science; another reports 
that she cannot spend time teaching writing skills; a third reports that 
she must teach proofreading rather than spelling. 

It is worth noting that while teachers report these changes in the 
curriculum, the National Assessment of Educational Progress (NAEP) tests 
have found increases in students' basic reading and mathematics scores 
counterbalanced by declines in science, writing, mathematical problem- 
solving and analytical reading. [2] A number of experts blame the 
emphasis on basic skills testing for these declines, noting that "a 



single-minded dedication to one goal— high scores on tests of minimal 
akills"[3] has changed what schools arid teachers emphasize. "What can 



[2] National Assessment of Educational Progress, Heading , Thlnkin 
find H£i£ing: Results from J&fc 1979-JB& National Assessment JsadlDg 
and Lit erat ure . Denver: NAEP, 1981; National Assessment of Educational 
Progress, £hangfi& ill Mathematical Achievement. 1211-UBL. Denver: NAEf, 
1 979; National Research Council, Uua State ££ School Science , 
Washington, D.C.: Commission on Human Resources, 1979* 

[3] "Experts Link Low Test Scores to Back-to-Basics, * Educatio n 
JJailXt October 24, 1979, p. 2. 
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be most easily tested and taught are now the teaching objectives in many 
schools, - observed the National Council of Teachers of Hatnematies 
president in hearings before the House Subcommittee on Elementary, 
Secondary, and Vocational education. [S] 

A recent Commerce Department study from the Office oi Productivity, 
Technology, and Innovation goes further in claiming that Innovation and 
creativity are being squelched by "the basic educational philosophy" 
which is better "at preserving convention than -sparking invention, 
developing logical than conventional thinking, promoting riSR aversion 
rather than acceptance of change. «E5] Learning theorists have likewise 
claimed that teaching children to produce correct answers on basic tests 
of reading and arrthmetic skills does not teach them to read or solve 
problems analytically. Indeed, some argue persuasively that test-based 
instructional strategies are counterproductive to the acquisition of 

practical knowledge. [6] 

Many teachers observe that when they are pressured to teach-to- 
the-test, scores in the tested areas increase, but other types of 
learning suffer. The more tightly tests are coupled to instruction, the 
more teachers resist the use of tests. Tight coupling of tests and 
teaching can occur either because of pressures to ensure that students 



E53 Office of Productivity, Technology and Innovation, Learn i ng 
^toi^nfca^ mnfisalian, Washington, D.C.: U.S. Department of 

""ES^fcTiSS; Anne M. Bussis, ^urn it at the Casket: 
Research, Reading Instruction, and Children s Learning of the First R, 
pS Ie^KaoDani December 1982, pp. 237-2*1 ; Constance Kamii,^ 
incolr^^ninking in Mathematics," ffi JfcU* December 19B2, 



pp. 247-251. 
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make a "good showing 11 or because the curriculum is designed to enforce a 
teaching* testing sequence for every skill area. 

Many teachers find the practice of gearing instruction to 
standardized tests to be educationally unsound arid professionally 



unethical. They describe how pressures to teach to the test occur: 



The principal made the teachers take [the test] and rewrite it 
so it wouldn't be exactly what the children were going to 
have, because he said he wanted the chidren to be sure they 
knew how to take the test. . . . Two teachers didn't do it, so 
he told them he was going to write them up and he said it 
would go in their personnel file. He wouldn't let them see a 
copy of it, and they called in the local teachers' association 
about it. 



Within a time frame of a couple of weeks before the 
standardized tests are given, we have booklets we are to 
present to the kids who are to be taking the tests and go over 
it with them. That takes time and energy out. That's what we 
are suppled to be doing. You can tell from my attitude that 
I don't particularly agree with it but that is what we are 
supposed to be doing. 



I see more of a trend 'to teach to test' so that your students 
will do well. 0ur administration says absolutely tests will 
not be used to blame but I don't believe it. I just can't 
believe that because tftey put in the newspapers the scores of 
different schools. A realtor in my community even showed me 
the test scores. . . . When parents come in, the realtor shows 
them the test scores of different schools when they want to 
buy a house in that communi ty . • __• __• So those scores are used 
in all sorts of ways they were never intended to be used. 



Schools are very receptive to parents and so when parents 
demand, 'I want coy son or daughter to do good on this test,' 
you have to meet tnose needs. I think some schools are very 
structured for these tests and they spend a lot of time 
working on the tests because that's the measure of 
achievement. You'd be foolish if you didn't. 
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Teachers talk about not getting to something because they had 
to deal with what is going to be on the test. They do spend a 
lot of time teaching what is going to be on the test. I 
certainly think that it :s a problem and yet this school 
system is a school system that has built a lot of little 
altars to those alanines and those standardized tests. 



Seine it has put a great deal of pressure on because I don't 
think they are that confident about what they are teaching so 

they really teach to the test. There are others who have been 

infuriated by it because they are forced to do something that 
they don't particularly believe in. Many teachers do not like 
standardized tests at all and resent giving them to their 
students. I think it's a pretty well accepted idea that 
standardized tests are certainly different frM tests given in 
most classrooms. You are more or less forced to teach the 
format of the test or you come up showing that your students 
haven't learned what you really feel they have learned. 



I think it is frustrating a lot of [teachers] because it does 
limit what you can do and how you do really interact with the 
kidSi It limits your time. Your attention is shifting from 
the student to "will he pass tnis test?" Or how many will 
pass this test? Will a majority pass the test? What happens 
if they don't? How will this afreet my job if they don't? 
That kind of thing. • . . It's just one more hail in the 
cbfrihi It's driving a lot of would-be good teachers but of 
the profession. 



Why do teachers feel that teaching to the test is undesirable? 



Many report that testing and test preparation take time away from 
teaching,- as though teaching for the test is not reailv teaching, and 
another type of instruction is what they ought to be engaged in. While 
many school board members and administrators apparently believe that 
teachers' resistance to testing is based on accountability avoidance, [?] 



teachers describe other motivations for their views. 



[f]_ Herbert C. Rudman, "The Standardized Test Flap, 2 Bit £stta 
JtefiESn, November 1977 f Pp. 179-185, 184. 
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Competency- Based Education 

The strongest reactions to testing are in response to competency- 
based instructional approaches that tightly couple instruction to 
testing by requiring students to pass a test for each discrete skill 
before progressing to the next. Some teachers say that children who can 
perform practical tasks in the classroom cannot do so in the form 
required by the tests; others say that tests don't measure important 
areas of learning. Many worry that the type of thinking encouraged by 
test-based instruction is hot conducive to stimulating interest and 
creativity. 



I've just found that I heed to give more tests, to teach 
certain things that will probably be on a test [rather] than 
branching of i" into a variety of dif rerent areas that may 
interest the students more. But you know what's going to be 
on the test; you know certain things that they have to have so 
you have to limit that. And I feel that often that stifles 
the kids' creativity because there is only one answer— only 
one right answer. Whereas the way the kid thinks, there may 
be more than one right answer. 



The only problem with that is the fact that it tends to stifle 
a lot of creativity by the student, if it [testing] is used 
but creativity is allowed to flourish under it, then I think 
it can be good. 



It Just seems deadly. It seems like a real ena to all growth 
and development. I mean would we have electric lights?. What 
if somebody hadn't said you should learn how to do this? 
Would we have hew inventions? Would there be anybody going 
dfr^njttffereht directions? WouldnH we end everything? If 
we programmed "this is what you are going to learnt 11 who would 
go beyond that? No, I just think that would be deadly. 
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In the first place, I don 1 t know who is going to say what 

everybody needs in order to function in society— -so that is 

going to be the hardest parti to set the objectives that they 
are going to have to know. But even if* you did that, you are 
going to end up with just a mold of one kind of person. You 
are going to end up with a whole population of the same little 
mold and I don't think that that's what democracy is all 
about. I think it means to be an individual. 



Whether these long-range fears are justified or not, inflexible 
implementation of test-based instructional strategies has visible short- 
term consequences. 

Teachers who have worked 5n schools that use a competency-based 
curriculum often find its immediate efrects troubling. One of our 



districts bad implemented a mathematics curriculum that required 
computer-administered tests of each skill before a child could progress 
to the next, teachers found the approach limiting for botn slower 
students and faster students: 



I have kids that are stuck at like level G (which is third 
grade) and they can't progress until they can do those blocks 
[subtraction with cuisinalre rods] . . • They can do it on 
paper, but they can't pass it on the computer which would 
finish out that area. 



I have some children who still are on that same level that 
they, started bh in September. And if they try three times 
then that's it. After the third time you're not supposed to 
frustrate them so now they're stuck in that category and they 
won't be able to get out. . . . They've tried three times. 
Now they've bad a couple of cases where they've said some 
children have bad particular difficulty [so] they'd give them 
something else. But they tried three times and so they can't 
progress in that one category. 



If a student could hot pass the test in a category, the student could 
not be taught anything else in that category. Testing thus prevented 
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both teaching and learning. Students who could pass the tests created 
another problem: 

What they have done is that they have put down every objective 
that they want every child to learn from kindergarten through 
eighth grade. There are volumes of objectives—absolute 
volumes of objectives. Each child has to pass the objective 
at this level before he can pass the next objective. So when 
I telt you that I spend absolute hours testing these • kids, I 
really feel like I have lost a lot of the math teaching time. 
I had the bright kids in the math—the top fifth and sixth 
graders in math. I was at the top so I had to get done 
[testing] everything that they were supposed to have passed. 
As the system operates now, I would throw it out. . . . for 
[the concept of] capacity, for measuring lengths and for 
weights and measures, what they really tested was whether or 
hot a kid understood the decimal system. . . . It is expensive 
and their study shows that it makes hb appreciable difierenee. 
Well, if it takes that much time and takes that much money and 
makes ho difference, then I say throw it out. 

Another district had begun to implement a competency-based 
curriculum for most subjects. In some schools, the use of the 
curriculum was not rigorously enforced. Teachers who could choose to 
ignore it often did. In others, textbooks and materials to accompany 
the curriculum Were absent. Those who had attempted to implement CBC 
had mixed reactions: 

What I have done is gone through the manual, twice, just to 
see what I could do with it. . . .There were a lot of examples 
that I couldn't use in my class because of their learning 
levels. Some I found were too hard. Others I found were 
boring— not useful, really. In other words, I felt that I 
could do something better . . . that would get over better. 
Sometimes I would say well, this is set up for an ideal class 
but it doesn't all work in the real world. 

• 

One teacher Who did not find CBC useful for her own teaching nonetheless 
thought it was a good management tool for helping or forcing less 
' competent teachers to do their jobs: 
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to be doing, CBe is very » ==41= „nf then vou're 

should be teaching thus and so. If you're Mt,tten yj?? re 

shortchanging the kids. So J «£=gg|* ^STtSSi it 
don't think it gives you. •"■^"•"^^fas ifi£a for 
for a oerson just starting out, I.thituc it is goo« 

!S!|i » B«t i mo " shortd 

have more teacher input. 

Another thought that the effort to establish a common curriculum was 
valid, but the CBC approach itseir trivialized the educational process 

I have no objection to some kind of definition of goals. ... 
You knoT one can go too far in the other extreme if you have 
no cSnali^rthfn you have chaos. In some ways^t i, > *oz 
?erf ^litically or socially responsible to allow that to 
filnLs So I have no objection to some enunciation or 

happen. ... So I nave no j are going 

tolearn orShe 'toils are going to be accomplished if all 
Of us adopt these particular techniques and these Particular 
structures to me seems to be absolute idiocy. ... Jf one has 
?he notLn that education is about learning pieces of 
knowledge or specific things to do in specific situations, if 
that is what one thinks education is, then education is headed 
for the down hill slide rather quickly. Whereas if you 
some kind of system where students were 
neourlged'to 5&1i thrown or to analyze a aituation^r 
to develop the alternatives, one would be nu ° h ^*^ a ^ er ^7 
trying to say, 'In this situation one does this or whatever. 
17* S the very technical kinds of things, if one 

San.t°understlnd e u, one can always look itmgmff^ 
so the point becomes how does one express oneself, how does 
ote Sitfafopposed to knowing exactly how a gerund is used. 

m schools where CBC is rigorously enforced, teachers feel torn between 
satisfying bureaucratic requirements and meeting the needs of their 



students: 



You're eiven a guideline and each day when the student comes 
lo elLf yoS.re^upposed to have on the board behavioral 
objectives *Tthe P day and a list of instructional aids and 
what have you. You're supposed to accomplish a, b, c 
whatever, in that day. The adminietrators come in and they 
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evaluate it haphazardly. They check to see are your goals_up, 
do you meet these goals this day, during this class period? 
That's realty unrealistic because it depends on the class. It 
depends on how prepared the students coie to class If they 
cone prepared with what you gave them the day before, and you 
can click it off one, two, three— -fine. But if they haven't, 
man, you hae to go over the material from the day before. 
Then you have to structure what you want to do today and you 
may tie way ofr from what your goal is. It just makes it kind 
of rigid^ ... A kid might have a question toat is off the 
track. Do you say, 'Well, no, I can't answer that question 
right how because I have these goals that I'm supposed to 
meet, and I just don't have the time?' You have to deal wltn 
what they want to know when they want bt know it or 1 you're 
going to lose their interest. But if your evaiuator^ comes in 
and you have 'heredity' on the board but you're talking about 
ecology or evolution or something, well then they're going to 
mark you down, because you're hot doing what you have bh the 
board. 

Some feel that their most valuable resources-- teaching time and the 
ability to capitalize bh ^ildreh's interest in learhihg--are diminished 
tjy rigid curricular and recordkeeping requirements: 



So much of the teacher's time is spent in things otner than 
teaching: record keeping, tee rigid curriculum guide 1 the pre- 
and post- testing ._. . and the massive record system to keep 
tiny little bits of it: when it is presented, when it is 
mastered, when it is re- taught and reinforced and post-tested. 
It is just mammoth . A gr^at deal of time and energy is spent 
with these sort of things and it limits sometimes taking off 
bh a tangent of the interest of the children because you have 
3 guide that isn't in that direction* You have to meet that 
guide because you know the children are going to have to take 
a test. You nay really get into some thing that you don't wane 
to leave, Ebut] you won't come back to tnat thing because toe 
schedule demands x number of minutes for this and that. You 

can't always teach an integrated core. I like a cor e 

curriculum where you can really integrate everything into it. 
I think it has more meaning to kids. I have only been able to 
do that one year. I had to have special permission and that 
was toe best year I ever bad. 



In sum, efforts to improve education by setting standards for 
students have various efrects at the classroom level. Sometimes 
standards, by providing a common yardstick, direct attention to areas of 
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the curriculum that would otherwise be overlooked • At the same time, 
policy tools that try to closely link these yardsticks to the teaching- 
learning process can have dysfunctional consequences When other valuable 
objectives are abandoned in favor of those that are measured. 

In the policies we have examined above, teachers reported problems 
of means-ends disjunctive, of inability to reconcile diverse educational 
goals, and of faulty implementation of policies, in general, their 
observations stem from the difficulty in adapting uniform educational 
approaches shaped by standard* performance measures to the perceived 
heeds of their clients. At the same time, many acknowledged the 
usefulness of the policies in providing a common direction or preventing 
abuse of discretion on the part of those less competent or canmitted 
than they* 

This situation typiries the classic dilemma of the street-level 
bureaucracy described by Michael Lipsky. Street-level bureaucrats must 
be simultaneously accountable to their clients and the public agency 
they represent: 



The essence of street-level bureaucracies is that they require 
people to make decisions about other people -._ Street^level 
bureaucrats have discretion because the nature of service 
provision calls for human judgment that cannot be programmed 
and for which machines cannot substitute. Street- level 
bureaucrats have responsibility Tor making unique and fully 
appropriate responses to individual clients and their 
situations. ._. . Ihese considerations cannot be sensibly 
translated into authoritative agency Sidelines, although it 
is on behalr of their agencies that street- level bureaucrats 
are accountable to clients. It is a contradiction in terms to 
say that the worker should be accountable to each client in 
the fashion appropriate to the presenting case. Tor no 
accountability can exist if the agency does hot know what 
response it prefers, and it cannot assert a preferred response 
if each worker should be open to the possibility that unique 
and fresh responses are appropriate. [8] 
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Lipsky describes how efforts to exert management controls can ultimately 
subvert service quality by reducing workers* accountabiity to clients 
and to professional standards of conduct. This can occur, he points 
out i when goal clarification reduces the scope and mission of public 
services by de-emphasizing areas that are not the focus of performance 
measures. Teaching for the test can mean teaching narrowly defined 
skills rather than concepts and practical applications; it can also mean 
teaching decoding and computing instead of writing and science; 
sometimes it means treating topics superficially rather than taking time 
for indepth inquiry. Decreased service quality can also occur when 
procedural constraints result in inappropriate treatment of clients. 
Teaching all students in a standard fashion may mean that some with 
different needs or learning styles will not be appropriately taught. 

Teachers are in an awkward position when they perceive problems 
with accountability standards. They recognize that some form of 
accountability is necessary, that without specification of goals and/or 
processes, a common educational experience may not occur. Performance 
goals and measures may be necessary to ensure that everyone is doing his 
or her job in a manner that Is responsive to the puolic mandate. But 
when standardization constrains the teacher's efforts to meet the needs 
of some clients, or when accountability tools take time way from real 
instruction, their frustrations surrace in requests for autonomy that 
seem to beg the question of accountability. 



[8] Michael Lipsky, Street-Level Bureaucracy, NY: Russell Sage 
Foundation, 1980, pp. 161-162. 
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If we could get the administration to leave us alone ana let 
us teach we'd be able to. Now of course I guess not all 
teachers would teach if they were. left alone. Because you 
hear tne stories of the teacher sitting at his desk with his 
feet up reading his newspaper and the kids aren't doing 
anything. But I guess basically if they'd let us teach, we 
could. We spend I would say probably a good 30 percent or 
more of our time doing paperwork. A good percentage of that 
completely unnecessary and another percentage is something 
that could be done by a teacher's aide or secretary. Time 
that we could and should be using to teach we're doing 
paperwork. Host of it is Just a waste of time. 

Paperwork, of course, is the means by which others in the school 
hierarchy keep tabs on what is happening in the classroom. This teacher 
implicitly recognizes that reports of attendance, test scores, and 
teaching objectives are meant to ensure that teachers are teaching and 
students are learning. But he considers it a waste of time because his 
conception of his job is client-oriented. His argument suggests that if 
teachers could be trusted to teach, the need for bureaucratic controls 
would diminish. 

One resolution of the dual accountability dilemma is to ensure 
competent teachers, thereby reducing the heed for bureaucratic controls 
designed to prevent incompetence. Although policymakers do not always 
regard standards for students and standards for teachers as substitutes 
for one another, the pressures for accountability in teaching are at 
least partly a result of mistrust in the capabilities of teachers. In 
the next section we consider state policies designed to upgrade the 
quality of teachers. 
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STANDARDS FOR TEACHERS 
Competonnv-b&aed Teaser C e rtification 

Over the last decade, the ideas of competency-based teacher 
education and teacher certification have been advanced as a way to 
upgrade training for and selection into teaching. Although full-fledged 
prototypes have yet to be developed, the ideas have been embodied in 
legislation in some states. While many teachers in our sample did not 
have direct experience with CBTE, they did have opinions about it. A 
definition of CBTE was contained in bur question to them; "All the 
knowledge, skills and behaviors which they [schools of education] think 
a teacher must use are specified, and the prospective teachers must 
demonstrate them in order to pass. 11 Of teachers in the sample, 21 
percent favored the idea, 35 percent favored the idea in principle but 
qualified their support or voiced skepticism about its feasibility, and 
ill percent opposed the idea. Those who were already familiar witn the 
idea tended to oppose it. 

Those who favored CBTE tended to interpret the definition as 
meaning good practice: 

I don't see anything wrong with it. If those are pretty much 
the things you need to know to go into teaching, it f s better . 
to know before you start the i things you are strong in and the 
things you might need improvement in. And I guess that you 
might start out with better teachersi If you start but with 
that, it might delay your employment for a year or something . 
I guess that would be the only drawback. You might not get a 
chance to go ahead and start. But it might satisfy the 
community and the parents a lot more and then you wouldn't get 
all the flack that you get about public schools. 



Those who gave the idea qualified support tended to adopt a wait-and- 
see attitude; 
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I think it may be very helpful; I don't know, .they didn't 
have anything like that when I was there. As I said, when I 
went into the classroom, I went in cold., So maybe this would 
be somewhat along the line of putting them into the classroom 
and letting them teach. Maybe by identifying these things, 
you have to show what they are and how to do them. So maybe 
that will cover the same thing that i was talking about. It 
doesn't sound lite a bad idea, but so many sound so good and 
come but so bad when they get into the classroom. I'd like t 
see how it worked, and if it worked, fine. 



Of those who opposed CBTE, some did so because they doubted that the 
skills could be compiled: 



Well, I think if anybody could write down all of the things to 
set up any kind of program like that, I would like to meet the 
person. I would think that it would be absolutely impossible 
to set down in some kind Of curriculumall the things a 
teacher had to be able to do to be competent. That would be 
Just such a mammoth Job. Maybe it would be possible but to 
test somebody on all the things that you need to be able to do 
. . . I Just don't see how it would be possible. 



Others who opposed the idea did so because of the standardization 
teaching implied: 



I think that it is absolutely ridiculous. I don't think that 
you can moid teachers into ... It is not an area of skill 
like learning now to use a power saw. There is a difference 
between manual skills and working with people, and I don't 
think that you can mandate how a person is going to work with 
somebody and have it come out with a hundred people doing it 
all the same way. 

One teacher had actually experienced competency-based teacher education. 
That teacher's observations are particularly telling: 



I am laughing because I went through something like that and 
this is the perfect example of what happened * * * we were 
trying to program to do this. It was supposed to be set up on 
a computer . . . this big design. You do the thing and they 
test you on it. Put it in the computer and you get the 
feedback. The only problem was that they never got it to tne 
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i **■ <!h f have never seen one 

computer to get the gf^S^fc'wiai i* t don't 
work. I don't know ! ^-W^TS £i ou talked about 
even know what tney are ^f^science^-in its true form, I 
Whether teaching was an art or a sole t0 deal with 

think it is an art. g^fJ^^L are going to be most 
at any given time, wnicn the conditions change, 

significant |B_i.PH4?» g £ philosophy of 

When you do these ^ndsofltogs as T*r J_ tQ meas ure 

teaching, they are so J^l^SmW * deal with P roblens 
something specif ic. *5f ^gg linear, single thoughts, 
that way. Human beings d ° n '^f ta ^nAbout, .did this 
And so what are you doing? *°Ygivtn sanation?' And it is a 
person do this at this time in a given ± _ place for 

very limiting kind of basis. ff J* 1 ^* ' ^nd 0 f eaucatxonal 
that kind of instructional level in a teachers are involved, 
situation whether the students ortte te acb^ ^ ^ 
But you have to recognize that that is a that . . 

And I think that-s probably the biggest in effect, 

. to say that it covers everything «J£ aud io visual 

do that. I can give you a perfect exampi three . 

course that I took ' 0 ^ t0 ^ an d Jou can do a competency 
. . how to operate the Projector ana^y you now 

test and that's great. But that is not joi g ^ ^ a 
to give instruction with a film to a cx« 
topic. 

pBTP reflect the view that just 
in general, teachers' opinions of CBTE reflect 

as teaching itseir is not a simple act easily reduceable to discrete 
Skills or behaviors, learning to teach is also more complicated than 
demonstrating easily Measurable competencies on discrete tasks. 
Ccpetency-based teacher certification is based on a view of teaching 
that assumes the validity, stability, and g,neralizability of effective 
teaching behaviors. Teachers tend to see teaching as a context-specific 
activity that cannot » easily prescribed because appropriate teaching 
behaviors vary from one student or classroom to the next. 

Research on aching reinforces this conception of teaching work. 
S«e efforts to link specific teacher characteristics or teaching 
colors to student outcomes have sought context-free generalizations 
-about what constitutes elective teaching, although this line of 
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research strongly suggests that what teachers do in the classroom does 
affect students, claims that discrete sets of behaviors consistently 
lead to increased Student performance [9] have been undermined by 
inconsistent and often contradictory findings. [10] The most extensive 
process-product study of teacher effectiveness, the Beginning Teacher 
Evaluation Study, conducted for California's Commission for Teacher 
Preparation and Licensing, found little support for linking teacher 
effectiveness to precise, uniform teacher behaviors. After that 
monumental effort, "(t)he researchers . . . concluded that linking 
precise and specific teacher behavior to precise and specific learning 
of pupils (the original goal of the inquiry) is not possible at this 
time. . . . These rindings suggest that the legal requirement for a 
license probably cannot be well stated in precise behavioral terms. "[11] 
At best, the teaching performances advanced as having consistently 
positive erfeets on student achievement are relatively broad constructs 
rather than discrete, specific actions of teachers. As Centra and 



Potter [12] note, often-cited variables sueh as clarity, variability, 



[9] B. Rosenshine and N. Furst, "Research on Teacher Performance 
Criteria, " in B. 0. Smith Led.), Research in Teaeher Education; A 
Symposium. Prentice-Hall, Englewood Cliffs, N.J., 1971; J. A. Stal lings, 
"How Instructional Processes Relate to Child Outcomes, " in G. D. Borich 
£ed.), The Appraisal of Teaching ; Concepts and Process. Addi son-Wesley, 
Reading, HA, 1977i 0. M. Medley, "The Effectiveness of Teachers, " in P. 
L. Peterson and H. J. Hal berg (eds.), Research on Teaching. MeCutchan, 
Berkeley, CA, 1979. 

[iOj W. Doyle, "Paradigms for Research bh Teacher Effectiveness," 
in l. s. Shuiman (ed.), feyifli, sL Research la Education, lal. 5., f. e. 
Peacock, Itasca, IL, 1978; M. J. Dunkin and B. J. Biddle, la& StudY sL 
Teaching. Holt, Rinehart & Winston, NY, 1974; R. Shavelson and N. 
Dempsey-Atwood, "General izability of Measures of Teacher Behavior, " 
Review of Educational Research. Vol. 46, 1976, pp. 553-612. 

[11J R. Bush, The Generator. Vol. 9, No. 1, 1979; see also F. J. 
McDonald and P. Ellas, Executive Summary Jtecogt; Beginning jE^gflSE 
Evaluation Study . Phase II. Educationai Testing Service, Princeton, NJ, 

1976. _ _ _ 

[12] J. A. Centra and D. A. Potter, "School and Teacher Effects: 
An interrelationat Model, " fieylfflt sL ffitijfijjasBal Research, Vol. 50, No. 
2, 1980, pp. 273-291 . 
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enthusiasm* task-orientation, use of student ideas, and question±ng[l3] 
are undoubtedly important* "but few of them could be usefully considered 
« basic teaching tastes. f 19 f 14] 

Furthermore* subsequent research on these variables has found that 
the effectiveness of particular teacher behaviors often depends on the 
teaching context. Effective teaching behaviors have been found to vary 
for students of different socioeconomic, mental, and psychological 
characteristics. [15] and for different grade levels and subject 
areas. [16 J Some teaching behaviors exhibit a distinctly curvilinear 
relation to achievement. That is, a behavior that is effective when 
used in moderation can produce significant and negative results when 

used too much [17 J or~as others have found— when applied in the wrong 

_ _ « 

circumstances. E 18] This kind of finding also makes it difficult to 



[13 J Rosenshine and Furst t op. eit. 

E 1 1»3 Centra and Potter, op. eit., p. 282. 

[15] hi J. Cronbach and R. E. Snow, Aptitudes and Instructional 
Methods ; ± Handbook for Beaeareh M Interactions, Irvington, New York, 
1977; J. E. Brophy and C. Evertson, Prooess-Product Correlations la ihs. 
^e*as Teacher Effectiveness fijaidi.: final JfiEfiCi, Research and 
Development Center for Teacher Education, Austin, Texas § 197*; and J. E. 
Brophy and C. Evertson, "Teacher Behavior and Student Learning in Second 
and Third Grades, " in G. D. Borich (ed.), Ihfi ftPPralsal fit JaaSfting: 
Concepts and Process. Addison-Wesley. Reading, MA^ 1977. 

[16 J McDonald and Ellas, op. eit.; N. L. Gage, Jh& Sc i e n t i f i c Bas i s 
4^ eg Teaching. NY: Teachers College Press, 1978. 

[17J.K. Peterson and D. Kauchak, Teacher Evaluation! Perspectives. 
Practices and Promises . Center for Educational Practice, University of 
Utah, Salt Lake City, 1982; R. S. Soar, faUflg Throu g h Cl as sroom Process 
Measurement and Pupil Growth. Institute for Development of Human 
Resources, College of Education, University of Florida, Gainesville, 
1972. 

E183 See t e.g., McDonald and Elias, op. eit.; Hi Coker , D. Medley, 
and R. Soar, "How Valid Are Expert Opionions About Effective Teaching?", 
fhi £fii£a. XafiEani 1980, pp. 131-149. 
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develop rules for teaching behaviors that can be generally applied. 

The conversion of teacher erfects research findings to rules for 
teacher behavior is a cornerstone of many competency-based teacher 
education and certification models. These models implicitly assume that 
the rules are geheralizable because student outcomes are determined 
primarily by particular uniform teaching behaviors. By implication, the 
models assume either that other contextual influence?* on student 
outcomes are relatively unimportant, or that these other influences do 
hot call for different teaching behaviors in order for teaching to be 
effective. But* taken as a whole, research on teacher effectiveness 
lends more support to a context-specific view of appropriate teacher 
behavior in which judgment plays a large role than to a view which 
presumes that specific teaching techniques or behaviors can be uniformly 
applied. Based on their many years of research oh teaching, Brophy and 
Evertson describe the teaching act as an interactive, highly Judgmental 
process: 

EE]ffective teaching requires the ability to implement a very 
large number of diagnostic, instructional, managerial^ and 
therapeutic skills, tailoring behavior in specific contexts 
and situations to the specific heeds of the moment. Effective 
teachers not only must be able to do a large number of things; 
they also must be able to recognize which of the maw things 
they know how to do applies at a given moment and be able to 
follow through by performing the behavior effectively. [19] 

Teachers' skepticism about competency-based teacher education 
results rrcm their feeling that the most meaningful aspect of teaching— 
the ability to make appropriate jud^ehts about what to do in specific 

~ [19] J. E. Brophy and C. H. Evertson, Learning £csn. leashing: A 
Develop mental Perspective ; Boston; iilyh and Bacon, 1976, p. 139* 
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instances— cannot easily be reduced to a set of discrete, observable, 
and measurable behaviors, their intuitions are supported by research on 
teacher effectiveness 

While only a few states have attempted to institute elaborate 
systems of competency-based teacher education or certification, a much 
larger number have attempted to upgrade teacher quality by requiring 
paper and pencil competency tests for teacher certification. 

Testing for Certification 

Testing of a potential teacher's knowledge of subject matter and 
pedagogy as a condition for certification is a recent state initiative. 
Technically, it is easy to devise a test of subject matter; it is more 
difficult to devise a test of pedagogy. Nonetheless, the imposition of 
such a test is far less expensive than competency-based certification. 
At least 16 states hav* enacted laws or rules requiring standardized 
tests as a means to raise the standards for entry to teaching, teachers 
are divided in their views about the usefulness of competency tests for 
certification. In the 1979 NEA survey, 41 percent of teachers favored 
statewide tests for certification. In our sample of teachers, 33 
percent favor the idea, 29 percent favor the idea with qualifications, 
and 38 percent oppose the idea. 

those who supported the idea felt that the test would screen out 
those who were hot well-prepared and would help to create the image of a 
profession; 

It probably is a good means of evaluating teachers 9 experience 
or ability to start teaching. * * * I know in other 
professions, for example, lawyers have to take a test, doctors 
have to take tests. Other professional people do, so perhaps 
' teachers, to be considered in full rights by many other people 
who are professionals, as professionals, maybe that is a thing 
we heed to institute. 



- 31 - 



ERIC 



Many who gave the idea of the test qualified support did so because they 
believe that a test of subject matter is both feasible and -iesirable, 
but they are skeptical of tests of pedagogy: 

I certainly think that if you are going to teach a subject, 
vou ouaht to be able to pass the basic requirements. . . .as 
?ar aslhe philosophy and everything, I don't think that being 
able to pass a test in that is tr uportant. 

A lot of the things that indicate a good teacher are not 
[susceptible to] standardized testing. , . * I *SaJfft5£ 
it is easy for a person to play a game with standardized teats 
and come up with a good score. It is easy to say on paper 
what you night do and in fact you won't. 

Those who opposed the test do not lelieve that a paper and pencil test 
can adequately predict performance as a teacher: 

I think the proof of the pudding is seeing what the teacher is 
doinTobserving the teacher and seeing what the children are 
learning. 

Some even believe that schools of education would focus unduly on 
preparation for the test . 

There again you get to a situation where teacher institutions 
are go?S to train their teachers to meet those competency 
IJandardl and that's it. They will feel like they have done 
their dob if they have done that. There i^too much of that 
that goes on as it is. There is far too much teaching of 
those minimum standards in colleges and universities to 
teachers right now. And I would hate to see it become 
dignified through state law. 

in sum, substantial support does exist for a test of subject matter 
knowledge Which is seen as guaranteeing that teachers know what they 
will teach. Many teachers see such a requirement as a prerequisite if 
not a guarantee of good classroom performance. However, substantial 
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skepticism exists with regard to the feasibility and practicality of a 
test of pedagogy i For many of the Same reasons that they doubt the 
usefulness of a competency-based approach to teacher education, teachers 
doubt the validity Of a paper-and-pencii test of pedagogical knowledge. 

* 

Testing for Reeertification 

Host teachers in our sample (60 percent) oppose the use of tests 
for recertifying teachers every few years. Opposition to testing for 
recertification is stronger than that to testing for certification 
primarily because a practicing teacher has a track record which can be 
examined; a test is seen as largely unrelated to performance in the 
classroom. 

Those who support the idea of testing for recertification see it as 
a. mechanism to ensure that teachers remain current in their teaching 
field: 

I think this is good especially in their major field. It 
keeps them abreast of the new currents^ the current trends, 
it keeps them abreast not only in the current trends but it 
helps them ihdi vidua! Xy. Teaching is a growing process just 
like learning is a growing process. 

Some who ^ve the idea qualified support distinguished between a test of 
subject matter and a mechanism to assess pedagogical skill: 

If you have stayed in the field and haven't kept up, something 
is wrong* As long as it is testing what is needed to be 
tested, i.e., being tested on the level that you are teaching. 
... I think the weeding out should be done more by 
administrative observation in some way rather than continued 
pedagogical testing. 

Those who opposed the idea stressed the importance of assessing 

classroom performance: 

■* - ■ • ■ 

« 
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If you can somehow rate a teacher's effectiveness and rate him 
on that . . . as my background being in economies . . . the 
way of testing output is to find out how many barrels go 
through the machine. You can't do that very well in a 
classroom. That is what you want, but I don't know how you go 
about getting it. Testing a teacher because of his knowledge 
in math and because of what he Knows about how to teach, is 
not going to ensure that he is a good teacher at all. 

I distinguish between understanding and performance. What you 
know, i thinK, can be tested in a standardized way. What you 
can do has to be evaluated personally. 

I 

The distinction between test performance and on-the-job performance 
is an apt one. Although these tests are meant to screen out incompetent 
teachers, studies have not found any consistent relationship between 
scores on teacher competency tests and measures of teacher performance 
in the classroom. [20] This should not be too surprising since the act of 
test- taking is quite different from the act of teaching. "Knowing" the 
answer to a question that asks for a definition of a pedagogical 
principle does not necessarily mean that one knows how or when to apply 
that principle in the classroom in the midst of competing pedagogical 
demands. Indeed, not knowing the answer to such a question may not 
preclude the ability to respond appropriately in the classroom setting. 

Although the existence of tests may raise the status of the 
teaching profession m the eyes of the public, they will not completely 
answer the question of how to upgrade the quality of teaching that 
occurs in classrooms. They may reveal what a teacher knows about a 



[20J J. B. Ayers and G. S. Quails, "Concurrent and Predictive 

Validity of the National Teacher Examinations, " iojpal £t 
Research. Vol. 73, No. 2, December 1979, PP- 86-92; J. H. Andrews, C. 
r^Blackoo n, and J . A. Mackey, "Preservice Performance and the National 
Teacher Examinations, - £tt SiUS Vol. 61, No. |* January 1980, 

PP 358-359; T. J. Quirk, et al., "Review of Studies of the Concurrent 
and Predictive Validity of the National Teacher Examination, " JfeiiSL sL 
fleaeareh . Vol. 43, 1973, PP- 89-114. 
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subject but will not reveal whether be can teach it and, if be can, 
whether be will. 

SCHOOL REALITY AND EDUCATIONAL POLICY 

The picture we have painted about the potential for improving 
teaching and learning by setting performance standards is not a 
promising one tor state policymakers. In one sense, it is a picture 
that can be easily dismissed by those whose faith in bureaucratic 
accountability tools is strong. Their faith may be unshaken by the 
skepticism of those being regulated. After all, discretion and autonomy 
can as easily be codewords for incompetence or nonperformance as they 
can be conditions for competent performance. 

In another sense, though, the observations of teachers must be 
considered. Teaching is a profession which is increasingly less able to 
attract and retain talented people in its ranks. If the normally 
tenuous psychic rewards or teaching work are further diminished by 
impediments to good performance as teachers* themselves perceive it, 
many among them will leave. A vicious cycle may be created by policies 
that in the aggregate make teaching less attractive. They lower the 
quality of the teaching force, thereby increasing the perceived heed for 
more regulation to improve education. 

Sane might argue that those teachers who voice skepticism about 

accountability policies are among the least competent. Very likely some 

teachers complain about standards because they find them too demanding. 

Equally likely there ae others who find them inadequate to the 

complexities of teaching work. However* most object to the 

^standardization which results from the policies rather than the 
* ______ 

standards contained in the policies. 
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The most powerful appeal which student standards have for teachers 
is that they symbolize the importance of education. In recent years, 
many perceive that schools have experienced a deterioration of 
educational standards. Many teachers welcome the reestablishment of 
educational standards as a reaffirmation that education is important. 
This reaffirmation or standards is an Indirect reaffirmation of the 
worth and work of teachers. 

The symbolic importance of standards is, of course, associated with 
the actual establishment of standards. This gives students, teachers, 
and the community at large a clearer understanding of at least the 
minimum goals of schooling. Some teachers welcome a clear external 

standard because it places the onus of achieving it oh the student while 

« 

lightening the onus on the teacher. They welcome wnat they see as the 
positive pressure on students. The teacher does not have to struggle 
with the establishment of standards and avoids internal and social 
conflict over how easy or how hard to make the standards. 

But teachers worry about the standardized test as an appraisal 
mechanism. They are concerned that the multiple-choice format is too 
limiting, that it cannot assess all the things which they teach. They 
are concerned about the results of a test being used to contravene their 
own Judgment about what students should and do know. They wonder 
whether the test matches tneir conception of the curriculum. 

More poignant, though, are the erfects of standardized testing upon 
curriculum and teaching. Teachers see the tests as altering the 
curriculum, somewhat by inadvertance. Seme of the erfects are obvious: 
testing takes time; preparation for testing takes even more time; there 
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is less tioe to teach and there is the pressure (perceived as both good 
and bad) on students and teachers to perform. Less obvious are the 
distortions introduced in the curriculum. Some teachers begin to 
emphasize the content which they know wiil appear bh the test. They 
begin to teach in a format that will prepare students to deal with 
content as it will be tested. Some teachers will even teach students 
the precise items which will appear on the test. 

The increased emphasis bh test-oriented content means, of course, 
that other curriculum content is deemphasized. Teaching as if there is 
always a right answer is thought by som<; teachers to stifle creativity. 
More generally, that which is not being tested is hot being taught. In 
the minds of seme teachers, the path from establishing standards to 
standardized testing to standardized curriculum and standardized 
teaching is short. One characterization of the erfects of very 
prescriptive teaching policies is consonant with the perceptions of 



teachers : 



Administratively mandated systems of instruction hot only 
hinder teachers 1 responsiveness to students but over time 
discourage teachers from learning to be responsive, from 
developing sensitivity to individual differences, and fran 
broadening their repertoire of approaches. Ultimately such 
systems become seir- fulfilling prophecies: routinized 

instruction, and the attendant loss of autonomy, makes 

teaching unpalatable for bright, independent-minded college 
graduates and fails to stimulate the pursuit of excellence 
among those wno do enter. Over the long ruh^ then, the 
routiliizatipn or instruction tends to de professionalize 
teaching and to further discourage capable people from 
entering the field. [21] 



Or as teachers put it: 



[21 J Gary Sykes, "Public Policy and the Problem of Teacher 
Quality," in tee Shulman and Gary Sykes (edsO, Handbook sL IgflcfttnK AndL 
Policy- New York, 1983. P. 120. 
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I feel sorry for any teacher who is interested in teaching. 
It is going to be much worse in the years to_ come. For those 
who lilce the record keeping, and there are plenty of them; 
pathetic teachers but great record keepers, this would be a 
way of them moving up the ladder. It will help them. It 
won't help the good teachers. It will help the people who 
teach by the book (because} it is sale and it doesn't require 
any imagination. 

The only thing that would make me leave teaching is if they 
ever computerize all these objectives and I have to sit tuere 
and check off forms for 38 kids and 250 different objectives. 
I thinK if it got down to that, I would simply resign because ■. 
I would feel like I was spending more time bh forms than on 
kids. 

Standards for teachers are a sbmewnat different matter. The 
rhetoric of CBTE has a certain attractiveness to it. Teachers should be 
competent; their competence should be tested rather than undetermined; 
competence should be ascertained as a, condition of graduation or 
certification rather than left to chance. Because the rhetoric of 
competency is so attractive, many teachers and others support the idea 
of CITE. In fact, some see its standard-setting aspect as tne 
definition of good teaching practice. But others see a large gap 
between the idea and the techniques necessary to make it work. Those 
opposed to the idea or the technique or both tend to see them as a 
mechanistic approach to education. In any case, the difficulties of 
implementing CBTE have largely prevented its actual use. 

Testing for certification currently has more widespread appeal. It 
is seen as making teaching somewhat more like the professions of law and 
medicine where a test external to one's educational institution 
determines whether one is certified to practice. Kany teachers, as many 
members of the public, perceive that unqualified people have been 
admitted to teaching. The test is seen as a way of screening out 
unqualified candidates. 

39 



- 38 - 

Many teachers favor testing for subject natter knowledge which they 
see as ensuring that a prospective teacher has a sufficient grasp of the 
subjects to be taught. Knowledge of subject-matter is viewed as a 
necessary bjjt not sufficient condition for teaching. How a teacher will 
perform is a function of many other conditions including a teacher's 
mastery of pedagogical skills. Almost universally, however, teachers 
are skeptical of the ability of tests to assess pedagogical skills. 
Consequently, the test endorsed by teachers does not reveal whether a 
person has the skills necessary to teach. 

Testing for recertification is less well regarded by teachers. In 
this instance, teachers are more inclined to believe that classroom 
performance is a better measure of whether a teacher should be 
certified. Prior to initial certification, a teacher does hot have a 
job and cannot exhibit actual on-the-job performance. Testing, while a 
less than perfect indicator of competence, may be the only measure 
possible. However, when a person has actually performed in the 
classroom, the idea of a test to measure subject-matter knowledge and 
pedagogical skills strikes teachers as irrelevant at best. Even if a 
test validly measures knowledge and skills, it does not measure how or 
whether %. teacher actually applies them to the conduct of a class. 

Thus, while some standards for students and teachers Say be 
desirable and even necessary to prevent incompetence or slothfulness, 
the more rine-grained the standards are, the more they attempt to 
specify in detail what are desirable learnings or teachings, the more 
likely they are to miss the mark and even cause damage to sane of the 
professed beneficiaries. Tom Green puts it this way: 
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hhU . Boiicy is a crude Instrument for securing »odal 
HSti iHouia not use a drop-forge to quarter a pound of 
tutSr-or B !n".£ d tc perfoS neart SUrgeg. Nttg «- 
the crop-forge or tb. f^^ou^pol^/deats «ith 
Knife orscaipel. That ^^S; not «itn », good 

fn°Ur V t?cular or M neighbor's or "even ufth tne good of us 
botrtollSer. 0 ^^ Sais aiw* «tn unat i. .eod^ 

construed U.*S«.i« « .« .^^^^S^Siaii 
benefits, but at the * ^^TJSini^s. 

+» flivavs bresent to our conscience wiw mw * „*j 
than Justice Injustices are nearly always specific, 
than justice. ah3u»i.j.^_ aovernment can't do 

justices seldom are. It ij tr« ™at dually true that 
everything we desire, and therefore, it is equally wue ^ 

itiVLm mm of children, it would remain doubtiul tnat we 

assumes that we may shape the axe into a scalpel. [22] 

If one accepts this analysis, the best policies are those that try 
to do the least; the most useful standards are those that provide 
general guidance to prevent gross injustices without exceeding their own 
capacity to erf act change. State policies, especially, should be 
reticent in nature since they rely on technical and political 
implementation through many layers of a bureaucracy. In this view, 
course requirements for students are preferable to highly specified 
performance measures; teacher competency tests limited to knowledge of 
subject matter are preferable to tests of pedagogical skill. Where 
technologies are uncertain and means-end connections are tenuous, the 
use or an axe to perform heart surgery may kill the patient* 

■ tliftbomas Green, -Excellence, Equity, and Equality, - in HajidJsa* 

-s£ Bashing ana m&s.i pp- 322-323. 
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Pat somewhat differently: 

Educational policies must be designed as a shell within which 
the fcerhai of professional judgment and decision making can 
function comfortably. The policymaker can no longer thiiuc of 
any given mandate as a directive which bears continuing 
correspondence to teacher actions at all times. Instead, 
policies represent moral and political imperatives designed 
with the knowledge that they must coexist and compete with 
other policies whose roots lie m yet other imperatives. 
Federal and state policies proress a prevailing view, 
orienting individuals and institutions toward collectively 
valued goals without necessarily mandating specific sets of 
procedures to which teachers must be accountable. [23] 

Of course, we come full Circle to the accountability question. How will 
we know whether the street-level bureaucrat is violating policy 
intentions without specific performance measures that can be examined by 
those in authority? j 

The roots of the answer lie in the reason for the question. 
Policymakers adopt performance measures as a means for exerting remote 
control over the educational process because they are suspicious about 
the adequacy of teacher supervisions They fear that supervision does 
not take place or that ttte judgments rendered by supervisors are 
inaccurate, ted studies of teacher evaluation practices suggest they 
are largely right. [24] Highly-developed and perceptibly effective 
teacher evaluation systems are rare in American education. The time and 
expertise of traditional supervisors are often inadequate to the task of 
critiquing, assisting, and monitoring the performance of teachers in a 
serious, concerted fashion. Indeed, the mistrust of teachers which 

[23 J Shulman, "Autonomy and Obligation," p. 501* 

[24] Linda Darling-Hammond, Arthur E. Wise and Sara R* Pease^ 

"Teacher Evaluation in the Organizational Context: A Review of the 

Literature, " Review af_ Edacatioha3r flo search , Vol. 53,. No; Si Fall 1983* 
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leads to .uMiiire Mi Policies Mi to prints, their 
traditional supervisors, as well. 

It IS here that the school improvement movement offers a ra, » 
hope for disentailing the accountability WW. By driwihg attention 
to the role of the sohool prinolpai as instructional leader, to aspeots 
0 , 30B601 climate inoluding norms of coll.glallty. and to the importance 

« sh«fid immm. * w*« * "* ffs " 1Te 80hools " 

.pproacbea point inolreotly to a means for achieving responsible 
aatonSy. Although there is room to quarrel with the spebifios of 
particular school improvement plan* (especially When they are couched as 
prescriptions), the central notion Kit schools are units of 
deoisioSiaicihg with their own incentive structures is important. The 
implicit view that professional interactions Song Principals and 
teachers can affect the quality of education is hopeful. 

The effective schools research upon which school improvement 
approaches rely is often criticised for being too general. KB » 
meant by strong instructional leadersnip. high expectations, or school 
climate* it is instructive to examine a description of what an 
e „ectlve principal does to create a client-oriented environment that 

supports the work of teachers -. 

in a recent article In the popular press entitled -Inner City 
School, Lift Standards with Help of Strong Principals. "[253 two 
principals in Biitlmore were highlighted as having drastically 
increased their school's aohi.v-.nt test scores and having or.at.d not 
only an ord.rly olimate but an academically exciting one. W did th.y 
,do7 Both establish^ and enforced rule, of discipline and class 

* * 

— ' [25 ] San ££ris& immk, February 23, 1983- 
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attendance. Beyond that, the first—Who is considered "a bit of a 
renegade who often ignores bureaucratic procedures"~brought in master 
teachers to guide other teachers and to find special teaching materials, 
and she brought in innovative, creative teachers while encouraging 
effective teachers already in the school and getting rid of poor ones. 
The second principal believes in giving teachers "a disruption- free 
environment" and then a great deal of latitude in how to teach. He says 
"there is ho single method of effective teaching." He does try to 
encourage teaching that increases students' "ambition, curiosity, and 

reasoning power." 

the concepts of collective autonomy and responsibility guided by 
high standards of client treatment undergird their approaches, fcipsky's 
suggestions for resolving the seemingly impossible tensions between 
accountability and autonomy share certain of these concepts. He 
proposes that "decentralized units given full responsibility for 
practice" can "[make] the most of the reality that street-level 
bureaucrats primarily determine policy implementation. "[26 J As part of 
this approach, he suggests that we must "develop in street-level 
bureaucracies supportive environments in which peer review is Joined to 
peer support and assistance in working out problems of practice. "C 27 J 
His approach includes peer assessments in the provision of services, 
worker contributions to determining assessment criteria, and ongoing 
consultation between workers and supervisors to provide systematic 
qualitative evaluations of actual practices 



[26 J Lipsky, op. cit., p. 207. 
' [27 J Ibid. , p. 206. 
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Mi*i «*t would support this conception of jfOOttr oontro! Shd 

iii^sm imum «8» supporter *** ^ "° 

wi.t-.oi proofs and profeSSldnSl development M. that oilov 
lot.rohsnge mm superb and service HOW roles for 

«• ***** t» 1 » He " SBnflne4 lireely ^ 

providing incentives for profeseion.li.ing the prsetlce effacing. 
This type of solution will require a more ..ribus investment in teacher 
recruitment, through student aid aha higher salaries, teacher 
preparation, through Sore intense and practice-oriented teacher 
education; and teacher retention, through improved financial and 
pmB working conditions coupled with serious evaluation and 



Si approach i. risky for policymakers. It relies on people, and 
it relies on judgments, it place, more W*i oh the dev.lop.ent of 
olient-respohslve practxces than on the definition of standardised 
practice. « assies that the. unable or unwilling to develop 
extend. «U S W«d.d out of the profession rather than have their 
^age controlled hy preaorlptlone for performSh^. it assume, that 
other* will become mor. capable hy engaging in the Joint construction of 
goals, definition of standard, of good practice, M oritibism, and 
eommltment to ongoing ino_uiry. » MS— in 8taff 

aevelopment, career incentives, »d evSluatien, i.i. . » the street- 
level bureSubrats themselves, .111 improve the ,u«lity of iirvie. 
delivery. 

Tb, risk, on thi Sid. of prescriptive poltbyiakiug. though, are at 
i«mt is grstt. «. have «M that many State policies hav. « short 
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life, are vague, and tend to be based on uncertain technologies -. 0f the 

once-popular policies reviewed in this paper, only teacher competency 

tests remain at the top of state agendas. As the true, expensive, and 

bureaucratic implications of policies like CBE and CBTE emerge, the 

popularity of the policies begins to recede. Hinimum competency 

testing, while still in its implementation phase (and only this year for 

the first time used to deny diplomas in one state), no longer enjoys the 

prominence which it was receiving. Early in its history, it was seen as 

coming to cover the spectrum of high school graduation requirements; now 

it has been relegated to basic reading and arithmetic skills. 

While these prescriptive policies may or may hot achieve their 

intended effects, they always have other unintended and cumulative 

consequences. Ihese additional effects must be weighed as one assesses 

the costs and benefits of a Specific policy. In particular, attention 

must be paid to the collective impact Of policies upon the role of 

classroom teachers-- policies that in the aggregate may make teaching 

less attractive, thus lowering the quality of the teaching force which, 

in turn, causes policymakers to regulate in an effort to improve 

» 

education. 
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